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Amendments to the Claims 

A listing of the entire set of pending claims is submitted herewith per 37 CFR 1.121. This listing 
of claims will replace all prior versions, and listings, of claims in the application. 

1 . (currently amended) A method of relating one or more trigger actions with a multimedia 
signal (101) , the method comprising; the stops of 

[[-]] providing at least one trigger time point (T n ; T n +i) and for each trigger time point 
(T n ; T n +i) providing at least one representation of least one associated trigger actio n (105) , where 
each trigger time point (T n ; T n+ i) indicates a time point of the multimedia signal (101) for which 
the at least one associated trigger action is to be available during playback of the multimedia 
signal-(±0±), 

[[-]] for each given trigger time point (T n ; T n+ i) deriving a fingerprint (102) on the 
basis of a segment of the multimedia signal (101) , where the segment of the multimedia signal 
(101) is unambiguously related associated with the given trigger time point (T„; T n +i), and 

[[-]] associating the derived fingerprint (102) with the at least one associated trigger 

action. 

2. (currently amended) [[A]] The method according to claim 1 , characterized in that the method 
further comprises comprising: 

for each obtained trigger time point (T n ; T n+ i), storing the derived fingerprint (102) and 
the at least one representation of the at least one associated trigger action (105) in a first database 



2 



Atty. Docket No. NL 030807 [PHLP 1906] 



Reply to non-final Office action of 26 October 2009 



Serial No. 10/564,297 



3. (currently amended) [[A]] The method according to claim 1, wherein characterized in that the 
one or more derived fingerprints (102) and/or the at least one representation of at least one 
associated trigger action (105) for the multimedia signal (101) is transmitted to a playback- 
device (300) via the Internet or in a side-channel of a broadcast channel or via some other 
channel or means. 

4. (currently amended) [[A]] The method according to claim 1 , wherein characterized in that the 
segment of the multimedia signal (101) is unambiguously related associated with the given 
trigger time point (T n ; T n +i) according to: 

[[-]] the segment of the multimedia signal (101) ending substantially at the given 
trigg e r tim e point (T ft t4 W),th e s e gm e nt of th e multim e dia signal (101) starting substantially at 
th e giv e n trigg e r tim e point (T aj^T-jn^-the segment of the multimedia signal (101) starting or 
ending at a predetermined distance before or after the given trigger time point (T n ; T„+i), or 

[[-]] the given trigger time point (T„; T n +i) being at a predetermined time point 
between a start and an end of the segment of the multimedia signal (101) . 

5. (Withdrawn) A method of detecting one or more trigger actions in a multimedia signal (101), 
the method comprising the steps of: 

- generating a fingerprint stream ( 1 04) on the basis of the multimedia signal (101), 

comparing a segment of the fingerprint stream (104) with one or more fingerprints (102) 
stored in a second database (203 ') in order to determine if a match exists or not between 
the segment and a fingerprint (102) in the second database (203'), the second database 
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(203') further comprising for each stored fingerprint (102) at least one representation of 
at least one associated action (105), and 

if a match exists retrieving the at least one representation of the at least one associated 
action (105) associated with the matching fingerprint (102). 

6. (Withdrawn) A method according to claim 5, characterized in that said method further 
comprises the step of: executing the at least one associated action (105) associated with the 
matching fingerprint (102) at an appropriate trigger time point (T n ; T n +i). 

7. (Withdrawn) A method according to claim 6, characterized in that the appropriate trigger 
time point (T n ; T n +i) is given by an unambiguously relation with a segment of a multimedia 
signal (101) used during generation of the matching fingerprint (102). 

8. (currently amended) [[A]] The method according to claim 1 , wherein characterized in that said 
multimedia signal (101) is an audio signal, a video signal or a combined audio/video signal. 

9. (currently amended) [[A]] The method according to claim 1 , wherein characterized in that said 
at least one associated trigger action (105) is selected from the group of: 

[[-]] retrieving and displaying additional information on a display, 

[[-]] retrieving and playing additional information via a speaker, 

[[-]] playing another multimedia signal instead of said multimedia signal (101) for a 

predetermined or variable period of time, 
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[[-]] stopping/pausing, e.g. temporarily, display/play, stopping or pausing playing of said 
multimedia signal, 

[[-]] executing other control commands, and and/or 
[[-]] prepairing preparing the system for user inputs. 

10. (currently amended) [[A]] The method according to claim [[1]] 2, wherein characterized in 
that the derived fingerprint (102) and/or the fingerprint (102) [[in the]] is stored in a second 
database and (203') is an audio and/or video fingerprint (102) . 

1 1 .(currently amended) A multimedia device (200) for relating one or more trigger actions with 
a multimedia signal (101) , the device comprising; 

[[-]] means (202; 201) for providing at least one trigger time point (T n ; T n +i) and for 
each trigger time point (T n ; T n +i) providing at least one representation of least one associated 
trigger action (105) , where each trigger time point (T n ; T n +i) indicates a time point of the 
multimedia signal (101) for which the at least one associated trigger action is to be available 
during playback of the multimedia signal (101) , 

[[-]] a fingerprint generator (202) adapted to^ for each given trigger time point (T n ; 
T n +i) a deriving a fingerprint (102) on the basis of a segment of the multimedia signal (101) , 
where the segment of the multimedia signal (101) is unambiguously related associated with the 
given trigger time point (T n ; T n+ i), and 

[[-]] means (2-04) for associating the derived fingerprint (102) with the at least one 
associated trigger action. 
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12. (currently amended) [[A]] The device according to claim 11, characterized in that the device 
further comprises comprising: 

a first database (203) having stored the derived fingerprint (102) and the at least one 
representation of the at least one associated trigger action (105) for each obtained trigger time 
point (T n ; T„+i). 

13. (currently amended) [[A]] The device according to claim 1 1 , characterized in that the device 
further comprises comprising: 

a transmitter (204) for transmitting the one or more derived fingerprints (102) and/or the 
at least one representation of at least one associated trigger action (105) for the multimedia signal 
(101) to a playback-device (300) via the Internet or in a side-channel of a broadcast channel or 
via some other channel or means. 

14. (currently amended) [[A]] The device according to claim 1 1 , wherein characterized in that 
the segment of the multimedia signal (101) is unambiguously related associated with the given 
trigger time point (T n ; T n +i) according to: 

the segment of the multimedia signal (101) ending substantially at the given trigger time 

point (TaT-T-a+i.)} 

the segment of the multimedia signal (101) starting substantially at the given trigger time 

point (TaT-T-a+i.)} 

[[-]] the segment of the multimedia signal (101) starting or ending at a predetermined distance 
before or after the given trigger time point (T n ; T n +i), or 
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[[-]] the given trigger time point (T n ; T n +i) being at a predetermined time point between a start 
and an end of the segment of the multimedia signal (101) . 

15. (Withdrawn) A audio and/or video playback device (300) for detecting one or more trigger 
actions in a multimedia signal (101) comprising: 

- means (302) for generating a fingerprint stream (1 04) on the basis of the multimedia 
signal (101), 

- means (302) for comparing a segment of the fingerprint stream (104) with one or more 
fingerprints (102) stored in a second database (203') in order to determine if a match 
exists or not between the segment and a fingerprint (102) in the second database (203'), 
the second database (203') further comprising for each stored fingerprint (102) at least 
one representation of at least one associated action (105), and 

- means (302) for, if a match exists, retrieving the at least one representation of the at least 
one associated action (105) associated with the matching fingerprint (102). 

16. (Withdrawn) A evice according to claim 15, characterized in that said device further 
comprises: means (303) for executing the at least one associated action (105) associated with the 
matching fingerprint (102) at an appropriate trigger time point (T n ; T n +i). 

17. (Withdrawn) A device according to claim 16, characterized in that the appropriate trigger 
time point (T n ; T n +i) is given by an unambiguously relation with a segment of a multimedia 
signal (101) used during generation of the matching fingerprint (102). 



7 



Atty. Docket No. NL 030807 [PHLP 1906] 



Reply to non-final Office action of 26 October 2009 



Serial No. 10/564,297 



1 8. (currently amended) [[A]] The device according to claim 1 1 , wherein characterized in that 
said multimedia signal (101) is an audio signal, a video signal or a combined audio/video signal. 

19. (currently amended) [[A]] The device according to claim 1 1 , wherein characterized in that 
said at least one associated trigger action (105) is selected from the group of: 

[[-]] retrieving and displaying additional information on a display, 

[[-]] retrieving and playing additional information via a speaker, 

[[-]] playing another multimedia signal instead of said multimedia signal (101) for a 

predetermined or variable period of time, 

[[-]] stopping/pausing, e.g. temporarily, display/play, stopping or pausing playing of said 
multimedia signal 

[[-]] executing other control commands, and and/or 
[[-]] prcpairing preparing the system for user inputs. 

20. (currently amended) [[A]] The device according to claim [[11]] Y2, wherein characterized in 
that the derived fingerprint (102) and/or the fingerprint (102) [[in the]] is stored in a second 
database and (203') is an audio and/or video fingerprint-(-H)2-). 

21 .(currently amended) A computer readable storage medium having stored thereon instructions 
for causing one or more processing units to execute the method according to claim 1 . 
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